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f^ • Abstract 

Mh ^ Consider a tree network T, where each edge acts as an independent copy of a given channel 

<~i ■ M, and information is propagated from the root. For which T and M does the configuration 

jrt , obtained at level n of T typically contain significant information on the root variable? This 

problem arose independently in biology, information theory and statistical physics. 

• For all &, we construct a channel for which the variable at the root of the 6-ary tree is 
independent of the configuration at level 2 of that tree, yet for sufficiently large B > b, the 

^ ' mutual information between the configuration at level n of the B-aiy tree and the root 

CO , variable is bounded away from zero. This is related to certain secret-sharing protocols. 

• We improve the upper bounds on information flow for asymmetric binary channels (which 
r«^^ ' correspond to the Ising model with an external field) and for symmetric g-ary channels 
l^ I (which correspond to Potts models). 

• Let A2(M) denote the second largest eigenvalue of M, in absolute value. A CLT of Kesten 
-^ ■ and Stigum (1966) implies that if 6|A2(M)p > 1, then the census of the variables at any 
r^ I level of the 6-ary tree, contains significant information on the root variable. We establish 

C^ ■ a converse: if &|A2(M)p < 1, then the census of the variables at level n of the fe-ary tree 

is asymptotically independent of the root variable. This contrasts with examples where 
&|A2(M)p < 1, yet the configuration at level n is not asymptotically independent of the 
root variable. 



1 Introduction 

Consider a process in which information flows from the root of a tree T to other nodes of T. 
Each edge of the tree acts as a channel on a finite alphabet A = {1, • • • ,k}. Denote by Mjj the 
transition probability from i to j, and by M the random function (or channel) which satisfies for 
all i and j that P[M(i) = j] = Mjj-. Let \2{M) denote the eigenvalue of M which has the second 
largest absolute value (A2(M) may be negative or non-real). At the root p one of the symbols of 
A is chosen according to some initial distribution. We denote this (random) symbol by dp. This 
symbol is then propagated in the tree as follows. For each vertex v having as a parent v' , we let 
(j„ = Mu/^^((Tt,/), where the {M^/^y} are independent copies of M. Equivalently, for a vertex v, let 



v' be the parent of f , and let T{v) be the set of aU vertices which are connected to p through paths 
which do not contain v. Then the process satisfies: 

Pk« = j\{(^w)w<^T{v)\ = P^t. = j\(Tv'] = M<^„, J- 

It is very natural to study this process in the context of biology, statistical physics and commu- 
nication theory. See [10|,[^2| and the references there for more background. 



Let d(, ) denote the graph-metric distance on T, and Ln = {v G V : d{p, v) = n} be the n'th 
level of the tree. For v gV and e = [vjw) G E we denote |f;| = d{p,v) and |e| = max{|f|, |w|}. We 
denote by (T„ = {(7{v))v^l^ the symbols at the n'th level of the tree. We let c„ = (cn(l), . . . , Cn{k)) 
where 

Cnii) = #{'V G Ln : (7{v) = i}. 

In other words, c^ is the census of the n'th level. Note that both ((Tn)^i and {cn)^=i are markov 
chains. 

For distributions P and Q on the same space the total variation distance between P and Q is 

a 

Definition 1.1. The reconstruction problem for T and M is solvable if there exist i,jGA for 
which 

limDv(Pm)>0, (2) 

n— >oo 

where P^ denotes the conditional distribution of Un given that cjp = L 

Definition 1.2. The reconstruction problem for T and M zs census-solvable if there exist i,j £ A 
for which 

limZ)v(pW'\p(f)'^)>0, (3) 

n-^oo 
(c) i 

where Pn denotes the conditional distribution of Cn given that ap = t. 

Assume that P[o"p = i] > for every i £ A. Then the following conditions are equivalent, see 



e.g. il: 



• The reconstruction problem for T and M is not solvable. 

• The configurations On are asymptotically independent of (Tp, i.e., lim^^oo ^{pp-, Cn) = 0, where 
/ is the mutual information operator. 

• The sequence ((Tn)J^^ has a trivial tail cr-field. 

• The distribution of {o"t;}t,gT is an extremal Gibbs measure. 



Similar conditions apply to census-solvability, where {c^} replace {o"„}. Note that if the recon- 
struction problem is census-solvable it is also solvable. 

The reconstruction problem was first studied in statistical physics for the Ising model on the 
tree, in the equivalent form as a question regarding the extremality of the free Gibbs measure 
for this model. See [^],|l^], [P,|14], [15| and [16|. Reference [|^] contains extensive background 



on this problem for the Ising model. In these papers the reconstruction problem for the Ising 

model on trees was solved. Writing X2{M) for the second eigenvalue of ( ) (that is, 

A2(M) = 1 — 2e), the reconstruction problem is solvable for the 6-ary tree T^ = (Vh, Eh) if and only 
if bX2{M) > 1. An analogous threshold for general trees was established in p 



A few combinatorial questions arise naturally in the context of these tree processes (see also Q , 
IP] and H]). In Section |2| we discuss the following question. For a channel M we ask does there 
exist any b such that the reconstruction problem is solvable for the infinite 6-ary tree Tf, and the 
channel M? In Theorem ^^ we present a criteria for deciding this problem for a channel M. Using 
this criteria we construct a channel with the following properties: 

Example 1.1. Write M^ for the h'th iteration of the channel M. Then for all h > 1 there exists 
a channel M such that 

• M (j) has the same distribution for all j G A. 

• For all h' < h there exist i and j such that M [i] and M (j) have different distributions. 

• When b is large the reconstruction problem is solvable for the tree Tf, and the channel M . 

This is a generalization of an example which appeared in [^] and |22|. In Section ^ we give 
more delicate constructions which are related to secret-sharing protocols (see [p4l)- 

Theorem 1.2. Let b > 1 be an integer and T be the 2-level b-ary tree. There exist a channel M 
such that for any initial distribution, ar and ag are independent (where ag is the configuration at 
the leaves of the 2-level b-ary tree), yet when B is sufficiently large, the reconstruction problem for 
the channel M and the B-ary tree Tb is solvable. 

It is tempting to try to find thresholds for the reconstruction problem which depend only on b 
and A2(M). For binary symmetric channels the threshold for reconstruction is 6A|(M) = 1 (this is 
also the threshold for census-reconstruction for general channels: see theorems |1.4| and |1.5| below). 



In 1 22 1 it is shown that for some natural generalizations of the binary symmetric channel, the 
threshold b}^{M) = 1 is not the threshold for reconstruction. In particular, it is shown that for 
the Potts model (the g-ary symmetric channel), where the transition matrix is: 

(4) 



M 



( l-(q-l)5 5 ...5 \ 

6 l-{q-l)6 6 



\5 ... 6 l-{q-l)6j 



if 6A2(M) = 6(1 — q5) > 1 and q is sufficiently large, then the reconstruction problem is solvable. 
Similar results hold for asymmetric binary channels. On the other hand, it is well known, see e.g. 



f2|, that for both famihes the reconstruction problem is unsolvable if < bX2{M) < 1. In Section 
we improve the bound bX2{M) < 1 by proving: 

Proposition 1.3. Let M be the matrix (0j. Then the reconstruction problem for Tf, and M is 

unsolvable when 

Similar results hold for asymmetric binary channels. The proofs are based on a reduction to 
symmetric binary channels on general trees which were analyzed in [p!o| ]. 

In sections 0, and ^ we consider census reconstruction and show that the threshold for census 



reconstruction is 6|A2(M)| = 1 . Prom [17| it follows that if b\X2{M)\ > 1, then the reconstruction 



problem is census solvable. We extend this result to general trees by proving: 

Theorem 1.4. Let T be an infinite tree and write br(T) for the branching number of the tree. Let 
M be a channel such that br(r)|A2(-/Vf)p > 1, then the reconstruction problem is solvable for T and 

M. 



The results of |17] also plays a crucial role in proving: 



Theorem 1.5. The reconstruction problem for the b-ary tree and the channel M is not census- 
solvable i/6|A2(M)p < 1. 



We conjecture that the result of Theorem 1.5 should hold also when 6|A2(M)p = 1, but we have 
verified this only for the following channels: 

Theorem 1.6. Let M be the q state Potts model, or the asymmetric Ising model, and suppose that 
bX2{M) < 1, then the reconstruction problem is unsolvable for the b-ary tree and the channel M . 

In Section g we discuss some open problems. 

Some of the results in this paper concern general trees. For an infinite tree T many of its 
probabilistic properties are determined by the branching number br(r). This is the supremum of 
the real numbers A > 1, such that T admits a positive flow from the root to infinity, where on every 
edge e of T, the flow is bounded by A"'^'. Here |e| denotes the number of edges, (including e) on 
the path from e to the root; br(T)^^ is the critical probability for Bernoulli percolation on T. See 
1 18 1 and |1C] for equivalent definitions of br(r) in terms of percolation, cutset sums and electrical 



conductance. We note that for the regular tree T^ we have br(T5) = b. 

2 Distinguishing states by tree networks 

Let M be a channel on an alphabet A of size k with A2(M) = 0. Looking at the Jordan form of M 
we see that rank(M ) = 1, and therefore M (i) has the same distribution for all i (^ A. Moreover, 
by Theorem |1.5| it follows that for all b, the reconstruction problem is not census solvable for the 
channel M and the tree Tf,. Does this mean that the reconstruction problem is unsolvable for T^ 
and the channel M? In this section we answer this question. 



Definition 2.1. Let M be a channel on A and consider the minimal equivalence relation r-^ on A 
which satisfies: If i and j satisfy for all i, 



J^M,,,, = ^M,,, 



(6) 



i'~i 



e'^e 



then i ^ j. If i ^ j, we say that i and j are indistinguishable. Otherwise, we say that i and j are 
distinguishable. 

The motivation for this definition is that if Mj^^ = Mj^^ for all i , then after one application of 
the random function M, one cannot distinguish between the hypotheses that i was the input and 
the hypotheses that j was the input. 

Theorem 2.1. // the states i and j are indistinguishable, then there exists N such that for all 
n > N and for all infinite rooted trees T: 



I)y(Pt„P^J=0. 
On the other hand, for every channel M , there exits h, such that for the tree Tf,: 

inf DviPl„Pi)>0. 



(7) 
(8) 



Example 2.2. Let {Zi}"?^^ be an i.i.d sequence of variables such that P[Zi = 0] = 1 — P[Zi = 
1] = p where < p < 1. Let h > 1 and consider the channel M defined by the markov chain 
Yi = {Zi, . . . ,Zi^h)- Thus M has state space {0,1}^"'^ with the product (p, 1 — p) probability 
measure. It is easily seen that all the states of M are indistinguishable. Therefore by Theorem \2.1\ 
there exists N such that for all trees and all n > N , it holds that Dv(Pn,Pn) = (one can take 
N = h). 



Example 1.1. Let {Zi} 



1 oo 



as in Example 2.i. Set 



Yi 



max {Zi 



Z 



i+j 



!}• 



It is easily seen that Yi defines a channel M on the space {0, . . . ,h}. Moreover, it is clear that for 
all i the variables {Zi}i>i+h+i and {Yi}i<i are independent. Therefore {Yi}i>i^h+i and {Yi}i<i 
are independent. It follows that the variables M'^~^^{j) have the same distribution for all j. Thus 
rank(M''+^) = 1, and \2{M) = 0. Writing M.- 



M 



/ V 
1 





Vo 



p{l-p) p{l-pf 




H-pf \ 





1 











p 



1 



p 



J 



we see that all the states of M are distinguishable. Therefore by Theorem [g.4 when b is sufficiently 
large we have for the tree Tb that inf„>i^jj' Z)y (P^, P^) > 0. Note that the channel above is obtained 
by lumping the channel of example 2A . This is a generalization of a channel appearing in ]1I|/ ; see 
also 



Remarks: 



Theorem 2J implies that if for a channel M all the states are indistinguishable, then X2{M) = 
0. 

Suppose that the channel M is reversible and has \2{M) = 0. Then looking at the diagonal 
form of M, it follows that rank(M) = 1. In particular, all the states of M are indistinguish- 
able. 



Proof of Theorem |2.1| : The first claim is easy. We define a new equivalence relation between 
states in A. We let i and j be equivalent if there exists an N such that for all trees and all n > A^ 
we have -Dy(P^, Pn) = 0. It is clear that this is indeed an equivalence relation and that it satisfies 
(|6|). The proof of the first claim follows. 

For the proof of the second claim let A! be the set of equivalence classes for ~. Let M' be the 
channel on A! defined as follows. For i',j' G A! we choose i & i' and define 

V[M'(i')=j'] = Y,nM{^=j]. (9) 

It is clear that (^) does not depend on the choice of i. Moreover, it is clear that for any tree T, we 
may couple the M tree process and the M' tree process in such a way that for all f in T we have 
that dt, G C7^. In particular, it follows that for all trees and all i G i' and j £ j': 

Therefore, in order to prove the second claim it suffices to show that there exists a b such that for 
the tree Tb and the channel M' we have, 

..inf DviK,Pi)>0. (10) 

The crucial property of M' we will exploit is that for all i ^ j £ A' we have (M^^) ^ (M'^). 
Thus in order to simplify the presentation of the proof, we will assume that the channel M on the 
alphabet A satisfies (Mj^^)^J-^ / (Mj^^)^J-^ for all i j^ j £ A 

We are going to show that for every e > 0, there exits b = b(e), and a recursive algorithm, which 
given the symbols at the n'th level of Tf,, reconstruct the symbol at the root with probability at 
least 1 — e (uniformly for all initial distributions of the root). This implies (see ||2^) that ( |lO|) holds. 

We let 6 = miujj- | (Mj £) — (M^^^) | ^o, and assume that e < 6/8. By standard results in the 
theory of large deviations (see e.g. Q), there exits a positive constant C such that for all i, if Xi 
is the empirical distribution vector of b independent trials with distribution Mj^, then, 

P[\Xi- bMu I oo I > b6/8] < exp(-C65). (11) 

Similarly, if X is the sum of b i.i.d. {0, 1} variables, each of which has the value 1 with probability 
e and the value with probability 1 — e, then, 

P[\X - eb\ > 6(5/8] < exp(-CW). (12) 

We now choose b such that exp{—Cb6) < e/2, and apply the following recursive algorithm in order 
to reconstruct the symbol at the root of the tree: 



• For each vertex v, construct the empirical distribution vector X^j of the reconstructed values 
for the children of that vertex. 

• Reconstruct at v the value i, where i minimizes the distance | X^ — 6Mj^^ | oo- 

It now follows by induction, that the probability of correct reconstruction is at least 1 — e. Indeed 
if this is true for all the children of v, then by (^), with probability at least 1 — e/2, for at least 
(1 — 5/4)6 of the children we reconstructed the correct value. Thus by (0), with probability at 
least 1 — e, the vector X^ satisfies | X^ — 6Mj^^ | oo < b6/2 where i is the symbol at v. It now follows 
that we reconstruct the correct value with probability at least 1 — e. ■ 

3 The distinguishing power of tree networks 

Let M be a channel on A and let T be a tree which consists of 2 nodes, the root r and an additional 
vertex v (the 1-ary 1-level tree). Suppose that I{ar-,(Jffr) = 0, where dT are the vertices in the 
boundary of the tree T (in this case f ), and I is the mutual information operator. The assumption 
I{(Jr,(yQT) = is equivalent to rank(M) = 1. Therefore, all the states of M are indistinguishable 
and the reconstruction problem for T[, and the channel M is unsolvable for all h. 



On the other hand, let T be the 2-level 1-ary tree. Example 1.1 is a channel M such that for 
the tree T we have I{ar,crdT) = 0, yet the reconstruction problem for Tj, is solvable when b is 
sufficiently large. 

It is natural to ask similar question for other finite trees T: Suppose that the channel M satisfies 
for any initial distribution I{ar,crQx) = 0, does this imply that the reconstruction problem for Tj, 
is unsolvable for all 6? 

Arguing as before, it is clear that this is the case if there exists a vertex in dT which is at distance 
1 from the root. We show that these are the only trees for which the 0- information condition implies 
non-reconstruction for all b. 

In the following theorem we give a construction related to secret-sharing protocols 



Theorem |1.2| Let b > 1 be an integer and T be the 2-level b-ary tree. There exists a channel Mi, such 
that for any initial distribution I{ar,o'QT) = 0, yet when B is sufficiently large, the reconstruction 
problem for the channel M and Tb is solvable. 

Definition 3.1. Let T be a finite field with q > b + 2 elements. Let xi, . . . , x^+i be a fixed set of 
non-zero element of T. We define a channel on the state space 

T'[x] = {fix) : fix) G J^[x],degf< b}. 

Given f, take L to be a uniform variable in the set {1, ... , 6 + 1}, then take M(/) to be g ^ ^ [^] 
which satisfy g(0) = /(x/) with probability 

{g G .F^[x] : g(0) = /(x/)} 



Proposition 3.1. Let {xi,... ,Xb+i} be a set of elements of J-. There is a one to one mapping 
from J^^[x] to J^^^^ defined by 

f^{f{xi),...J{xt+i)). (13) 

The inverse map is defined by the interpolation polynomial: 

Lemma 3.2. Let T be the 2-level b-ary tree. Then for any initial distribution, I{ar,o'Q) = 0. 

Proof We show that for all / G J^^[x] and h = (hijf^.^^ e (J^^[x])''' it holds that 

P[agT = h\ar = f] 

is independent of /. This would imply the claim of the Lemma. We denote by (wj)^=i the children 
of r, and by (wij)^,^^ the children of Vi. We then have 

P[agrp = h\ar = f] = ^ P[\/i,ay^{0) = ai\ar = f]P[crdT = h\yi,ay^{0) = ai] (15) 

ai,... ,ai,eF 

b 

= ^ P[Vi, (7^,^(0) = ai\ar = /] JJ P[Vj, C7^„,^^ = hij\ay^{0) = ai]. 

ai,...,ai£F j=l 

b 

= q-'' Yl P[Vi,cT,,(0) = a,|a, = /]J]P[Vj,a^,^^(0) = /i,j(0)|a,,(0)=a,]. 

ai,...,ai,£F j=l 



Note that Lemma 3.1 implies that if xi, . . . ,Xj is set of nonzero elements and 1 < j < b, then the 
uniform distribution measure on JT" [x] satisfies for all yi , . . . ,yj,a ^ J- that 

P[V 1 < i < j, f{x,) = yi\f{Q) =a]= q~K 

Thus the probability at the right hand side of (O): 

P[Vj>«,,,,(0) = /ii,i(0)|a^,(0) = ai]. 

does not depend on Oj. Now the claim follows. I 

Lemma 3.3. Let {xi, . . . , x^+i} be a fixed set of non-zero element in T . For an element f E J- [x] 
satisfying f{xk) = yk for 1 <k <b + l and a permutation tt G S'b+i we define f^^ to be the element 
of F\x] which satisfy 

f-n{Xn(k)) = Vk- (16) 

Moreover, for a,b €z J- define: 



nnb 



[if,7r) e F\x] X Sb+i : /(O) = a, /JO) = 6}| . (17) 



We then have for all a ^ b,c ^ d that 

na,b = nc,d, na,a = nc,c ■ (18) 

Moreover, for all a ^ b, 

na,a > na,b- (19) 

Proof We note that if c G F, and / G F''[x], then (/ + c)^ = fn + c Similarly, if / d G F, then 
(4f )?! = df-jr. Thus, for ah a, b we have na+c,b+c = ^a^b and nda,db = ''^a.fe- Relations ( |I^ ) now follows. 

Looking at (14) one sees that the elements of J-^[x\ which satisfy 5(0) = a are exactly those 



elements which satisfy the equation 

6+1 
^Cig(xi) = a, 

where Cj are some none zero constants. 

Thus the elements g of J- [x\ which satisfy g(0) = a and 5,7(0) = & are exactly those elements of 
.F*[x] which satisfy the equations 

b+l 



^Cig{xi) = a, (20) 



1=1 
and 



6+1 

^CTT{i)9{xi) = b. (21) 



Note that by Proposition 3.1 the number of solutions of these equations, 8,7(0, 6), in J^^[x\ is the 
same as the number of solutions of these equation over J^ in the variables 5(^1), . . . ,g{xh+i)- It 
now follows that for every permutation vr 7^ 1 and a ^ b: 



Moreover, when tt = 1, 



Now, 



s-7r(a, &) < 5,7(0, a). (22) 



= sn{a,b) <s^{a,a) = q\ (23) 



na,b= ^ Sj,{a,b) < ^ s,r(a,o) = na,a, 



as needed. 



Lemma 3.4. Let f,g(z J- [x]. Then f and g are indistinguishable in the sense of definition 2.1 if 
and only if f = g-w for some vr G S^+i ■ 

Proof. We will write / ~i 5 to denote that / and g are indistinguishable, and / ~2 5 when there 
exist vr G Sh+i such that f = g-w- It is clear that if / ~2 5; then / ~i g. 

On the other hand, suppose that / -^2 g- We will show that there exist an /i G J- [x] such that 



Y, p[M(/) = /.']/ Y. nM{g) = h]. 

h'^2h h'~2h 



(24) 



This would imply that indeed ~i=~2 (see definition |2.1| ). We may write ( |24D equivalently, 

Y p[M(/) = /i^]/ Y. nM{g) = h^]. 

Writing n f{a) = \{1 < j < h + 1 : f{xj) = a}\, we may write the left hand side of ( p5[ ) as: 



(25) 



(^ + 1)^ 



(26) 



TrGSi,-).! 



Summing over all h G J?^ [x] with /i(0) = a in (Pq) we obtain: 

ia,anf{a) + Eb^a"a,6n/(6) _ (n„_„ - na,a+i)nfia) + (6+ l)na,a+i 



n„ 



'+l)q^ 



' + l)q'' 



(27) 



(by (jT^) we may write Ua^a+i for Ua^b when a ^ b). Since f 0^2 g there exists a ^ T such that 
nj(a) > ng{a). Thus: 



^ P[M(/) = /j^] 

h:?i(0)=a,7rG5(,+i 



> 



{ng^a - na^a+i)nf{a) + (6 + l)rea,a+i 
{b+l)qb 

{ria^a - na^a+i)ng{a) + {b+ l)na^a+i 
{b+l)q^ 



(28) 
Y P[M{g) = h^]. 

h:h{0)=a,TTeSf,+ i 



where we have used the fact that by (19) Ua^a > ''^a.a+i- It now follows that there exists an h for 
which (|25|) holds. ' ' ■ 



Proof of Theorem 1^: Fix b and let T be the 2-level 5-ary tree. Let M be the channel defined 



at definition 3.1. Lemma 3.1 implies that for any initial distribution I{ar,o'Q) = 0. 



On the other hand by Lemma 3.4, the channel M satisfies that / and g are indistinguishable 



for M if and only ii g = f-,^ for some vr. It follows by Theorem 2.1 that when B is sufficiently 
large the reconstruction problem for Tb is solvable (moreover, when B is sufficiently large we may 
reconstruct {f-K^-K^Si+x the equivalence class of /, with probability close to 1). ■ 



10 



4 Improved bounds for Potts models 



In this section we will focus on the following two families of channels: 

• The asymmetric binary channels. These channels have the states space {0, 1} and the matri- 
ces: 



M 



l-6i 6i 
1 — 62 62 



(29) 



with A2(M) =62- 5i. 

The symmetric channels on q symbols. These have the state space {!,... ,q} and the matrices: 

\ 



M 



f l-{q-l)6 S ...6 

6 I -{q- 1)6 6 



\^ 



(30) 



5 l-{q-l)5 ) 



with \2{M) = 1 



The reconstruction problem is unsolvable for ( poD when 1 6A2 (Af ) | < 1 and unsolvable for (^) when 
< h\2{M) < 1 (see Propositions 3 and 4 in p^]) On the other hand, Proposition pT] implies that 
when bX^iM) > 1 the reconstruction problem is solvable for these channels. Moreover, the main 
results of p^] states that the reconstruction problem for (p9D is solvable when b\2{M) > 1 and 5i 



is sufficiently small; Similarly, the reconstruction problem for (30) is solvable when h\2{M) > 1 
and q is sufficiently large. In this section we improve the existing bounds for non-reconstruction by 
showing that: 



Proposition 4.1. Let M he defined by the transition matrix ^2^)- Then the reconstruction problem 
for Tb is unsolvable when 



62 + 5i - 
Similarly, the reconstruction problem for a general tree T is unsolvable if 



br(T) 



(<52-<5i)^ 

(^2 + '5l 



< 1. 



(31) 



(32) 



Proposition 1^. Let M be the channel (^^. Then the reconstruction problem for Ti, is unsolvable 
when 



l-(q-2)S- 

Similarly, the reconstruction problem for a general tree T is unsolvable if 



(33) 



(34) 



Propositions 1.3 and 4.1 follow from the following theorem. 



11 



Theorem 4.2. Let M be a channel and let i,j be two states such that for all k ^ {i,j} it holds 
that Mj^fc = Mj^fc, and there exist < e < 1 and /3 > 0, 7 > such that 






■jd 



a 



e e 

1 



+ 



(3 7 
(3 7 



If Ti) is the b-ary tree and ba{l — 2e)^ < 1, then lini„^oo -Dy(P^, P;^) 
general tree with br(r)a(l — 2e)^ < 1, then lim„_^oo -Dy(PJj,P^) = 0. 



(35) 



0. Similarly, if T is a 



Proof of Proposition 4.1: li 61 + 62 < I write: 



l-,5i Ji 

1 — (52 ^2 



&2 



{Si + 62) 



Si 



5i+52 <5i+<52 
<5i+52 <5i+<52 



+ 



1-61-62 
1-61-62 



and the proposition follows from Theorem 4.2. Otherwise, write 



l-<5i ,5i 
I — 62 62 



where 6'i + 62 < 1, and use a similar decomposition. 



6[ l-6[ 
S'2 l-S'2 



Proof of Proposition 1.3: For all i 7^ j we have 






(1 - (g - 2)6) 



l-(q-l)S 5 

l-((?-2)5 l-{g-2)S 

5 l^{q~l)5 

l-((?-2)5 l-(g-2)5 



and the proposition follows from Theorem 4.2 



Proof of Theorem 4.2; Assume that the label of the root is chosen to be i or j with probability 
1/2 each and let X denote this random label. For a set W, we denote by Yyy the random labeling 
of the vertices of W, and Yn = Y^^. We will show that 



lim /(x,y„)=o, 



(36) 



where I is the mutual information operator, i.e., I{X,Y) = H{X) + H{Y) — H{X,Y) where H is the 
entropy operator (see for more background). Equation ( [3^ ) is equivalent to lim„^oo Dvi^n^^n) = 
0, see e.g. |2|. 

We will split the proof into three main steps. 
Step 1 [10]: If M is the binary symmetric channel. 



M 



1-e e 
e 1 



then for a general tree T and a set W, 

I{X,Yw)< j;(l-2e)2H. 



(37) 



(38) 



wew 
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This is Theorem 1.3 in |[lO[| . 

Step 2: We wih show that it suffices to prove the theorem assuming that 

instead of (p^). Indeed, assume that the theorem is true under the condition (^). Now let M be 
a channel which satisfies (p5|). Consider the following auxiliary channel A^. The channel has the 
state space A' = AU {i* ,j*} and the following transition matrix N: 



1. 


For all i {i,j} and all £' G A, set N^,^' = M^^^/ 








2. 














1-e 
e 


e 
1- 


- e 


3. 












/ N,,,. Ni,j. \ 


1^/3 


7 ' 


\ 




V j)«* iii* / 


V/3 


7 . 


/ 


4. 


For all £, set Nj.^^ = Nj^^ and Nj.^^ = Nj^^. 









It is clear that if the original channel M satisfied the conditions of Theorem 4.2, then the chan- 
nel A^ satisfies these conditions with ( p9|) replacing (|35|). By our assumption this implies that 
lim„_+oo ^(AT, Yn) = 0, where Yn is the labeling of level n for A^. 

Writing Yn for the labeling of level n for M, we note that y„ may be obtained from Yn by 
replacing each occurrence of i* by i and each occurrence of j* by j. By the Data Processing 
Lemma (see e.g. j^) it now follows that 

/(x,y„)</(x,y„)^o, 

as needed. 



Step 3: We the theorem assuming that (39) holds. We begin by introducing two random variables 



Z and Y. Recall that path(f ) is the path from p to v. We let: 

Z = {{v,ay) : 3w G path(v),cr^ ^ {i,j}} , (40) 

and given a set W, let 

Yw = {iv,a^) : V £ W^w G path(w),o-^ G {i,j}} . (41) 

We denote Y^^ by Yn- Roughly speaking, Yn contains all information on the i ^ j and j ^ i 
process from the root to level n; Z contains all information which is independent of this process. 
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By the Data Processing Lemma 

I{X,Yn)<I{X,{Yn,Z)). (42) 

Since for all d. ^ {^,j} it holds that Mj£ = Mj_^, it follows that Z is independent of X. We 
therefore obtain 

/(X,(y„,Z)) = H{X)+H{Yn,Z)-H{X,Yn,Z) = H{X\Z)+H{Yn\Z)-H{X,Yn\Z) 

= E,I{X,Yn\Z = z). (43) 

We will show that for almost all z, 

lim I{X,Yn\Z = z) = 0. (44) 



Since < I{X, Yn\Z = z) < 1 for all z, this would imply the theorem by (|43| ) and (|42|). By the Data 
Processing Lemma, in order to prove (44), it suffices to prove that for a.e. z there exist cutsets Wn 



for which 

\im I{X,YwjZ = z) = 0. (45) 

n— >oo 

(Recall that VF is a cutset if W intersects every infinite path emanating from p; If Wn is a cutest, 
then and if for all v £ W^ we have i < \v\ < i', then by the Data Processing Lemma it follows 

I{X,Ye,)<I{X,YwJ<I{X,Ye), 

so (H) is equivalent to (|5|)). 

The key observation is noting that given Z = z we have a broadcast process with the binary 
symmetric channel ( ^7\ ) on the tree 

Tz = {v ■.'iw £ Tpath{v),aw G {hj}} ■ 



Therefore by Step 1, in order to prove (^5|) it suffices to show that for a.e. z, there exist cutsets 
Wn such that 

^lim Y.{1- 2ef-\ = 0. (46) 

However, for a general tree T, we have br(T2) = abr(T) for a.e. z. So if abr(r)(l — 2e)^ < 1, then 
(|46| ) hold for a.e. z for appropriate WnS. Equation ( ^q) holds for T^ when ba{l — 2e)^ = 1 by |19, 
Theorem 3]. ■ 

5 br(T)|A2p > 1 implies reconstruction 



The following proposition is a consequence of the results of [17|. 

Proposition 5.1. Suppose that 6|A2(Af)p > 1, then the reconstruction problem is census solvable. 
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In this section we prove an extension of the proposition to general trees. 



Theorem [1.4| . Let T be an infinite tree and M a channel such that br(T)|A2(M)p > 1, then the 
reconstruction problem for M on T is solvable. 

In order to prove this theorem we are going to bound from below 1)^2 (P^, Pn "') where 



DJPQ)-^ y^ 2(P(a) - Q(a))^ (47) 

^^ '^^"2\/^ P{<y)+Q{a) ' ^^^' 



is the x^ distance. 
Lemma 5.2. 



Dl2<Dv<D^2. (48) 



Proof. The first inequahty in (^) follows when we use the estimate: 

2\P{a)-Q{a)\ 
P{a) + Q{a) - ' 

while the second follows from Cauchy- Schwartz when we write: 






We prove Theorem 1.4 by constructing linear estimators of the root variable for finite trees and 



then evaluating the first and second moments of these estimators. 

Abbreviate A = A2(M), and take w to be a right eigenvector (that is, Mf = Xv) with \v\2 = 1- 
We use the notion of flows and view the tree as an electrical network. We refer the reader to B 



and [10 1 for definitions and more background. For a finite tree T, we consider T as an electrical 



network, where we assign the edge e the resistance 

i?(e) = (l-|Ap)|A|-2N. 

For a vertex x, we let Cx = e, if the label of x is i, i.e. if ax = i. 

We say that a set of vertices W is an anti-chain if no vertex in VF is a descendant of another. 

Lemma 5.3. Let T be a finite tree, W an anti-chain in T , and /u a unit flow from p to W . Consider 
the estimator 



fj.{x)cx ■ V 

xew 
Then for all i £ A, 



xew 



E^[5^] =ee-v, (50) 

and there exist a constant < c{M) < 1 which depends on M only such that 

c(M)(l +7^eff(p ^ W)) < minminE^[|5„Pl < minmaxE^[|5.P] < (1 +7^cff(/0 ^ W)). (51) 

Hi M / 
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Proof. If X is at level n, then 

Bi[c^] = CiM". (52) 

It follows from (^) that for every column vector v we have 

El^[c,■v]=e^M''v. (53) 

If we take u to be a vector such that v is an eigenvalue of M which corresponds to A = X2{M), we 
obtain, 

K[cx-v]=X''ee-v. (54) 

Now (|50|) follows by linearity. 

We let path(x) be the path from p to x (more generally let path(x, y) be the path from x to 
y). We let x Ay, be the meeting point of x and y, that is, the vertex farthest from the root p on 
path(x) npath(y). We have: 

E^[\{Cx ■ v){Cy ■ v)\] = '^P^[CxAy = ei]'E[\{Cx-v){Cy-v)\\CxAy = ei] 

i 

= Y.^'[c.^y = e,]\e,-v\^\\f^^y^ <\\f^'y\ (55) 

i 

Therefore, 

^%s,\'] < E rmrE^IK-^ • -)(-. -)l] < E t^##- (^6) 

U Ml J - Z^ A 1^1 A 12/1 ^ ^IJ - Z^ \\\2\x/\y\ ^ ^ 



Since 






L = i+ E ^(^) 



|A|2|-I 

' ' eepath(u) 



if follows that for all 



E^[|5^|2] < (1 + E ^(e) E leepath(xAy)^(x)/u(y)) = (1 + E ^(e)/^'(e)). (57) 



When we take the minimum in (57) we obtain. 



minmaxE'^riS'.P] <imn{l + S^R{e)p^{e)) = (l + 7^eff(p^ W)) , (58) 

f^ e ^J. ^-^ 



where the equality in ( |5q ) is Thompson's principle (see Doyle and Snell Q). Equation ( pSD is the 
left hand side inequality in (|5l|) . The proof of the other inequality in (p^) follows in a similar way. 
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Proof of Theorem |T]|: Since |A|2br(T) > 1 it follows that 

T^csiP ^ OO) = SUp7^eflF(p ^ Ln) < OO. 



(59) 



We consider linear estimators as in Lemma 5.3 and note that if v is an eigenvector as in Lemma 



5.3, then 



C{M) = max |ej ■ v — Cj ■ v\ > 0. 

id 



(60) 



We fix a level n, take i and j such that we obtain the maximum in (aH), and consider a linear 
estimator as in Lemma ^^ for W = L^, such that the upper bound in (5T|) holds. We obtain that 



Y,S,{a){Pl,[a]-Pi[a]) 



> C{M). 



(61) 



On the other hand, by Cauchy-Schwartz we obtain that 

< 4(l+7^eff(p^L„))D2,(Pj„P^J. (62) 

Combining (^) and ( |62[ ) we obtain that for all n 

C{Mf 



D\{Vl,Vi)> 



4(l+7ecff(/0^^n))' 



(63) 



So the theorem follows by Lemma IsT 



Proof of Proposition |5.1| : For the 6-ary tree T^ we have br(rfc) = h. Moreover, the flow /u which 
minimizes X]e-^(^)A*^(^) ^'^ ( pg) is the flow which satisfles /x(e) = 6"l'^l. This implies that we may 
take Sn to be 

_ Cn-v 



In particular Sn is a function of c„. Now, arguing as in the proof of Theorem \A we see that there 
exist i,j for which L)y(P„ , Y'n '') is bounded away from for all n. ■ 



6 Census reconstruction fails when 6|A2p < 1 

In this section we prove non-reconstruction when 6|A2p < 1. The proof relies on the Kesten-Stigum 



theorem [17]. The following is an immediate consequence of Theorem 2.3 of |T 



Kesten-Stigum CLT [17]: Let M he a transition matrix such that 5|A2(M)p < 1 and let vr be 
the stationary distribution for M, i.e., the normalized left eigenvector for the eigenvalue 1. Then 
for any vector v of M which is orthogonal to n, and for all j £ A, 






AA(0,a) 



(64) 
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where M denotes a normal random variable and a does not depend on j. Moreover, the convergence 
rate may he hounded in term of\v\2 only. 

An immediate consequence is: 

Proposition 6.1. For all i,j and e > 0, one may couple cli and c^ in such a way that, 

lim P[|4-d| >e6"/2i = q. (65) 

Proof. If follows from the Kesten Stigum theorem that 

where AA is a normal variable which does not depend on L The claim follows, as for all (5 > we 
can couple both c\ and c^ with the same normal variable h^l'^M in such a way that 

P[|c^-6"/2AA| >e6"/2] < ^^ 
for both i = i and I = j. I 



Theorem 1.5. //6|A2(M)| < 1, then the reconstruction problem is not census solvable for the 



b-ary tree and the channel M. 

The proof is easier when all the entries of M are strictly positive, in which case the following 
lemma is trivial. 

Lemma 6.2. Let M be irreducible and aperiodic, then there exists an h such that for all i and j 

all n > h and all v, 

P[cl, = v]>0 iff P[ci = v]>0. (66) 

Proof. Since (Mjj)^ • j^ is irreducible and aperiodic it follows that there exists an i such that the 
matrix M is strictly positive. Thus, for every two states i and j we may construct a £ level tree 
such that the root of the tree is labeled by i and all of the leaves are labeled by j. Let h = i{k + 4) 
and n > h. Suppose that P[c^ = v] > 0. Then there exists a labeling of the tree of n levels which 
has i at the root and a at level n, and such the census of o" is v. We will prove the lemma by 
constructing a labeling where the root is labeled by j, level n is labeled by r, and the census of r 
is V. 

We denote by xi, . . . , a^^n-f the vertices at level n — L For xt we define c{xt) to be the census 
of the subtree rooted at xt for the labeling a. Let u = (ui, . . . , u^) be a non-negative vector which 
satisfies X^Uj = b ■ Define c{cr,u) = \{t : c{xt) = u}\. Note that if c(a,u) > then there exists a 
labeling of the i levels tree, denoted t{u), which has u as its census and such that the label of the 
root for this labeling is CFp{u). 

Since 



E 



c((T, u) mod 6 j u = mod b , 
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it follows that 

V = b w + y^ ( c{a, u) mod b j n, 

u 

for some integer valued vector w. 

Note that if for root value j, we could label ^^ (c((T, n) mod 6 ) of the vertices of level n — i 
by labels (Tp{u) with multiplicity c{a,u) mod 6^, then we are done. Since using these vertices, it 
is possible to build the J2u ("^("^j ■") ™od 6^) n part of the census. Now using the other vertices at 
level n — £ it is possible to build the b^w part of the census (whatever labels these vertices have). 
Note that 



c{a, u) mod b^) < b^\{u : Vi, Ui>0,^Ui = b^}\ < bV^ = 6^^^ 






Therefore by assigning b^^'^^' of the vertices at level n — 21 the task of producing the prescribed 
labels at level n — i we obtain the required result. ■ 



Proof of Theorem |l.5| : We take h such that ( p6D holds for n > h. We may write: 

<+H = ES'(^nm (67) 



rk 



where S** is a random walk on Z which satisfy: 

P[S\t + 1) = S\t) + v] = P[4 = v]. 



By (pq), all the S'' are random walks with the same support. 

By the local CLT if follows that if |c?i — c^| < eV5", it is possible to couple c^^^^f^ and c^_|_/j with 



probability /(e) where /(e) ^ as e ^ 0. Now the result follows from Proposition 6.1. 



7 Census reconstruction for Potts models fails at criticality 

In section |6| we presented a proof that 6|A2p < 1 implies that the reconstruction problem is not 
census-solvable. We believe that this result is also valid when 6|A2|^ = 1. In this section we prove 
that this is the case when M is the q state Potts model or the Ising model with external field. 



Theorem 1.6. Let M be the q state Potts model, or the asymmetric Ising model, and suppose that 
bX2{M) < 1, then the reconstruction problem is unsolvable. 

Proof. We prove the theorem for the 3-state Potts model, the general proof being similar. It is 
convenient to denote the states of the channel by —1, and 1. We show that for all i,j G {—1, 0, 1} 
there exist a coupling such that P[c^ = c^] — > 1 as n — > oo. By symmetry, it suffices to find such 
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coupling for c^ and c„^. We denote by a^ the coloring with 1 at the root, and a for the coloring 
with —1 at the root. 

During all the steps of the coupling we require that for all v we have cr~ = iff 0"+ = 0. The 
main step in proving the existence of the required coupling is given in the following lemma. 

Lemma 7.1. There exits p* > such that: Given (cTt,)|^|<„ and (T„)b|<„ which are coupled in such 
a way that a^ = iff t^ = 0, there exits N > n and a coupling procedure for ((Ti,)|i,|<jv and (T^)|^|<Af 
such that a^ = iff Ty = and such that P[c^ = c^] > p* (where c^ and c]y are the a and r level 
N census vectors respectively). 

By iterating Lemma [7.1| , the coupling probability P[c^ = c~^] may be made arbitrarily close to 
1 for large n. ■ 



Proof of Lemma 7.1: At level n there are two types of vertices: those for which a^ = r^, and 
those for which a^ = — t„ G {—1,1}. For all the vertices w whose ancestors v at level n satisfy 

O'V = Ty, we let ay^ = Tyj. 

Denote the vertices v at level n which satisfy a^ = —t^ S {—1, 1} by vi, . . . ,ve. Let T be the 
graph which consists of the subtrees rooted at t>i, . . . ,V£. 

We think of T as drawn in the plan, and denote the vertices of level m by w™, . . . , vJL-m- We 
will slightly abuse the notation by redefining 

C(i) = \{j : 1 < i < ib^-"',a{vj') = i}\, c^i) = \{j : 1 < j < £b^-^,T{vJ') = i}\. (68) 

Note that cj^ = c^ in the old definition if and only if it does in the new one. 

We define X^ = c^(l) — c5^(— 1) and X^ = c^(l) — cj„(— 1). Note that if a coupling of a and 
r satisfies u^ = iff t„ = 0, then we have c^ = cl^ if and only if X^ = X^. 

We define the coloring of T as a dynamic process starting at the root, running level by level 
from left (u^^) to right {v^„^,n). Writing v' for the parent of v, we let 

S^vr) = m--X^+ Y^ m-'^ Y^ {a{v>y)-ea{vf)) + {her"^Y.^a{vf)-ea{vf')), 

n<k<m jKtb*^-^ j<i 

(69) 



where we formally define Up/ = 0. We define S'^ similarly. Note that all the terms in ( p9| ) except 
the first one, have mean zero, and therefore both S'^ and S"^ are martingales. Also, 

S''{v^,^-„) = m-^X^, S-{v2m-r.) = [bOr^Xl,. (70) 

The coupling consists of a few steps, during all of which we require that for all v we have ct^, = 
iff Ty = 0. 

1. Reflection until we reach N such that: 

-^/h^Ci <X^ = -Xlf < CiVb^. (71) 

We label the vertices level by level, left to right using the rule ay = — Ty, until we reach vf 
with \S'^{vf)\ < (1 + 6){b9)~^ and N large. From lemma 7.2 below, it follows that such a 
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vertex exits a.s. Now X^ — (bO) S'^{vi^) is a sum of ih — i independent variables with 
values —1,0, 1 and expected value 0. It therefore follows by the CLT that with probability 
going to 1 as Ci ^ oo we have |^^| < CiVb^ . Therefore, by continuing the reflection 
<y{Vj^) = —t{v^) for i < j < £6^~", we obtain (l7l|). We let Y^_^_^{i,j) be the number of 
vertices in the a labeling which are at level A^ + 1, of type j and have a type i parent. All 
these variables are binomial and 

E[r^':i(i,j)|c^1 = m-9)/3 + 5,,b9)c''/{t). (72) 



2. Labeling the O's of level A^ + 1: We label all vertices of level A^ + 1 with a{v 



N+l^ 



^{^j ^ ) = independently with probability 



P[a«+^) = 0|a((.f +^)')] = P[r«+^) = 0|r((.f +^)')]. 

We thus achieve that cJf_^_l{0) = c^^^{0). 

By the CLT it follows that with probability going to 1 as C3 ^ cxd, 

and therefore for j 7^ 0, 

|E[y;';i(i, j)|c^^y;•;l(^,o)] - E[y;';,(z, j)|c^ni < c,Vh^\ (73) 

3. Labeling some of the it of level A^ + 1. Let zq be the maximizer of c^(i). For i ^ iq 
we label all vertices v at level A^ + 1 which have a parent of type i and satisfy cr(f ) 7^ by 
±1 using the reflecting coupling cr{v) = —t{v). By the CLT it follows that with probability 
going to 1 as C4 ^ 00 we have for i ^ io and all j 

\YZ,(i,j) - E[Y^'l,{i,j)\c^/,Y^'l,{^,0)\ < C,Vb^. (74) 

4. Local CLT for the final coupling. We now want to label the remaining vertices with ±1 
to achieve X^r+i = ^^f+i- We note that Z"^^ = ^''^(io,!) - Y"^'' {io, -1) are sum of i.i.d. 
±1 random variables and therefore satisfy the local CLT. Moreover, by (|7^), it follows that 
with high probability each of the Z's is a sum of at least £b ~^^~'^{1 — 6)/6 such variables. In 
order that X^^-^ = XJ^^^ we need that Y.iY^'ii, 1) - Y^'ii, -1) = Y^i^'^ii, 1) - l'^(«, -1). 
By ([7^),([73|) and (|7^) it follows that for i j^ io and with probability going to 1 as C5 ^ 00, 

\{Y'^'^i,l)-Y'^^^i,-l))-b9c''/{i)\ < cVb^W. (75) 

Similarly, by (|7^) and 



|E[y'^'-(io,l)-y'^'^(io,-l)|c^^>^^';l(^,0)]-Wc^^(io)|<C5V6^^ (76) 

Now by (|75|),([7q),(|7l|) and the fact that until now we used reflection, it follows that Z'^ + W'^ = 
Z'^ + W^ where W'^''^ are random variables which satisfies W^ = —W^ and with probability 
going to 1 as Ce ^ 00, \W'' - W^ - (E[Z'"] - E[Z^])| < CqVW+^. By the local CLT, it 
follows the with probability p* > we may couple Z"^ and Z'^ in order to achieve X'^ = XJ^ . 
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Lemma 7.2. A.s. S"^ changes signs infinitely often. 

Proof. We prove that X^ changes sign infinitely often a.s. By the Borel-Cantelli lemma it suffices 
to prove that for all n and all o"(f)|„|<„ there exists m > n such that P[^m > 0|'''('^)|D|<n] ^ 1/4. 
However, by the Kesten-Stigum theorem [17|, there exits some Om — > c>o such that given (t(u)|^|<„, 



Xm/dm converges to a non-degenerate normal random variable with expected value 0. So when m 
is large, P[X^ > 0|(t(v)|^|<„] > 1/4 as needed. ■ 



8 Unsolved problems 

8.1 Critical values 

Except for symmetric binary channels there are no interesting families of channels for which the 
critical value for reconstruction is known. 



Problem 1. For the 3 symbols Potts model (jSQ ) find the critical value for reconstruction. 

The same question applies to asymmetric binary channels, and to proper colorings (which cor- 
respond to the zero temperature anti- ferromagnetic Potts model). Proper colorings of trees were 
studied in P]; The corresponding transition matrix is 



M 



/O (q-l)-' (q-l)-' ... (q-l)-' \ 

(g-i)-i (g-1)-' ... 

V (9-1)-' ••• (9-1)-' / 



(77) 



A simple coupling argument (see ||2|) shows that if 6 < g — 1, then the reconstruction problem is 
unsolvable for colorings of Tf,. On the other hand, applying standard coupon-collector estimates 
recursively (similarly to Theorem |2.1j), it is easy to see that if 6 > (1 -|- e)qlogq and q is large. 



then the reconstruction problem is solvable. By Proposition 5.1 and Theorem R^, the census 



reconstruction problem is solvable if 6 > {q — 1) , and unsolvable if 6 < (^ — 1 



Problem 2. For fixed q, for which b is the reconstruction problem solvable for the channel (Tl)? 



8.2 Soft inputs - Robust phase transitions 



We like to mention briefly the notion of "robust" phase transition which first appeared in [23|. 
Consider the usual reconstruction problem, but suppose that the data at the boundary is given 
with some additional noise. The proofs that if ^A^M) > 1 the reconstruction problem is (census) 
solvable are immune to this noise. However, this may not be the case for the reconstruction problem. 
Indeed, we suspect that adding this additional noise (assuming it is fixed but sufficiently strong) 
will shift the phase transition to the point ^A^M) = 1. A similar phenomena was proven in [|2^ 
for the phase transition of uniqueness. For n and m, we denote by an,m the configuration which is 
obtained from o"„ by applying the random function M"^ independently on each of the symbols in 
an- We denote by P^^ the conditional distribution on an,m given that Up = £. We then 
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Conjecture 1. For all M and b, such that b/\^{M) < 1, there exists m such that 

8.3 Monotonicity 

For Potts models (Q), it is easy to see that if the reconstruction problem is solvable for q and e 
and q' < q, then the reconstruction problem is also solvable for q' and e. We expect that for fixed 
A = A2(M), reconstruction is easier when q is larger. 

Conjecture 2. Consider two symmetric channels Mi and M2 (as in ^) on qi and q2 symbols 
respectively, where qi < 52- If X2{Mi) = X2{M2) and the reconstruction problem is solvable for Mi, 
then it is also solvable for M2 ■ 

This is obvious when 52 is a multiple of qi. Using the reconstruction criteria for the binary 
symmetric channel on 2 symbols, it is easy to prove the conjecture when qi = 2. 

Acknowledgments: We thank Olle Haggstrom, Claire Kenyon, Laszlo Lovasz, Jeff Steif and Peter 
Winkler for helpful discussions. 
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